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SUMMARY The multi-edge type LDPC codes, introduced 
by Richardson and Urbanke, present the general class of struc- 
tured LDPC codes. In this paper, we derive the average weight 
distributions of the multi-edge type LDPC code ensembles. Fur- 
thermore, we investigate the asymptotic exponential growth rate 
of the average weight distributions and investigate the connection 
to the stability condition of the density evolution. 
key words: low-density parity-check code, structured codes, 
weight distributions 

1. Introduction 

In 1963, Gallager invented low-density parity-check 
(LDPC) codes [1]. Due to the sparseness of the repre- 
sentation of the codes, LDPC codes are efficiently de- 
coded by the sum-product (SP) decoders [2] or Log-SP 
decoders [3]. The Log-SP decoding is also known as 
the belief propagation. By the powerful method den- 
sity evolution [3], invented by Richardson and Urbanke, 
the messages of the Log-SP decoding are statistically 
evaluated. The optimized LDPC codes can realize the 
reliable transmissions at rate close to the Shannon limit 
[4]- 

Recently, many structured LDPC codes have been 
proposed: accumulate repeat accumulate codes [5], 
irregular repeat accumulate codes [6], MacKay-Neal 
codes [7], protograph codes [8], raptor codes [9], low- 
density generator-matrix codes [10] and so on. These 
structured codes are usually designed for exploiting the 
structure to realize an excellent decoding performance, 
efficient encoding, a fast decoding algorithm, a paral- 
lel implementation and so on. Above all, the multi- 
edge type LDPC (MET-LDPC) codes [11] give a gen- 
eral framework that unifies all those structured LDPC 
codes. 

The average weight distribution of codewords, 
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which is simply referred to as the average weight distri- 
bution, helps the analysis of the average performance 
of the maximum likelihood (ML) decoding [12] and the 
typical minimum distance [1]. The decoding errors for 
the high SNR regions are mainly brought by codewords 
of small weight. Constructing LDPC codes without 
small weight codewords helps to lower the error floors. 
For the average weight distribution of the standard ir- 
regular LDPC codes are studied in [12]-[16] and those 
of structured codes are studied in [17]— [19]. Specifi- 
cally for the standard irregular LDPC codes, the aver- 
age weight distribution is derived in [15] as the coeffi- 
cients of some polynomial. And many useful properties 
[13], [16] arc derived from the coefficient expression. 

In [18], we have already derived the average 
weight distributions for the MET-LDPC code ensem- 
bles. However, the derived equation [18] is not as sim- 
ple as that of the standard irregular LDPC codes [15] 
and is hard to investigate further properties. Indeed the 
derived equation in [18] is not written in a closed form 
but given as a recursive form which concatenates the 
weight distributions of constituent codes of the MET 
code ensembles. In this paper, we derive the average 
weight distributions of the MET-LDPC code ensembles 
in a simple closed form. Furthermore, we investigate 
the asymptotic exponential growth rate of the average 
weight distributions and investigate the connection to 
the stability condition of the density evolution. 

The rest of this paper is organized as follows. Sec- 
tion 2 gives the definition of the MET-LDPC code en- 
semble. Section 3 gives the simple expression for the 
average weight distributions of the MET-LDPC code 
ensemble. In Section 4 we derive the asymptotic expo- 
nential growth rate of the average weight distributions 
and investigate it for the codeword of small weight in 
Section 5. Furthermore, in Section 6, we show that 
the connection between the the asymptotic exponen- 
tial growth rate of the codeword of small weight and 
the stability condition of the density evolution [4] . 

2. Multi-Edge type LDPC Codes 

Before we give the general definition of the ME-LDPC 
codes, we show a specific example of MET-LDPC code 
for a better understanding. The Tanner graph of an 
example of MET-LDPC code is shown in Fig. 1. We 
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NT (0,0,0,0, 1) 




NT" (0, 3,0,0,0) 



NT" ( 2, 0, 0, 0, 0) 



Fig. 1 The Tanner graph of a Multi-Edge type LDPC code. 
NT and ET stand for variable node-type, check node-type and 
edge-type, respectively. 



use the terms, a "code" and its "Tanner graph" inter- 
changeably. The edges in the graphs are divided into 
5 types of edges labeled from "ET 1" to "ET 5". Note 
that there are two types of edges in the third row of 
edges. With this classification, each edge is said to 
have edge-type i for i = 1, . . . , 5. Furthermore variable 
and check nodes are classified into types according to 
the number of each edge-type they have. The types 
are called variable and check node-types, respectively. 
For example, the check nodes labeled "NT(2,2, 1,0,0)" 
are said to have node-type (2,2,1,0,0) since these check 
nodes have two edges of edge- type 1 , two edges of edge- 
type 2 and 1 edge of edge- type 3. And the variable 
nodes labeled "NT(0,0, 0,0,1)" are said to have node- 
type (0,0,0,0,1) since these variable nodes have 1 edge 
of edge- type 5. 

The original definition of MET-LDPC [11] codes 
involves the transmissions over the n t types of parallel 
channels. Since our interest in this paper is limited to 
the average weight distributions, we restrict ourselves 
to the transmissions over a single channel, i.e. n x = 1. 

For simplicity of notation, we define 1 = (1, . . . , 1) 
and = (0, . . . , 0). And define that x > means that 
Xi > for i = 1, . . . , n. Moreover, we use the notation 



n 



for two vectors x = (x\, . . . , x n ), y = (y\, . . . , y n ) of size 
n. 

Now, we give the definition of an MET-LDPC code 
ensemble. Analogously to the degree distribution pair 



(A(x), p(x)) [16] for the standard irregular LDPC code 
ensemble, an MET-LDPC code ensemble is specified by 
a multivariate polynomial pair (i/(r,x), /z(x)) which is 
also referred to as the degree distribution pair. 



b,d>0 

M x ) : = ^ dxd ' 



d>0 

b := (6 ,6i, • • -,b n J,d := (di, . . .,d n J, 
r := (r ,ri, . . . ,r„J,x := (zi, . . . , x n J 

where n x is the number of channel-types and n e is the 
number of edge- types. 

For a given degree distribution pair (z/(r, x), //(x)) 
and code length n, we define an cqui-probable ensemble 
of LDPC codes with graphs G that satisfy the fallow- 
ings. 

1. G has n variable nodes of channel-type b = (0, 1), 
i.e. G has n un-puncturcd transmitted bits. 

2. G has n^b,d variable nodes of channel-type b and 
node-type d. 

3. G has n\x& check nodes of node-type d. 

We denote this code ensemble by C(n, v(r, x), /i(x)). 

It is easy to see that the number of edges of edge- 
type % incident to variable and check nodes of node- type 
d are respectively given as 

^ diUv htA = dini/( 1)0 ),d + d»>W(o,i),d! 

b>0 
d>0 

It follows that the number of edges of edge-type i inci- 
dent to variable nodes and check nodes are respectively 
given as 



nvi(l, 1) := 



r=l 
x=l 



b,d>0 



n/Xi(l) := n— /i(x) 



x=l 



d>0 



for i = 1, . . . , n c , where 1 := (1, . . . , 1). They are con- 
strained to be identical, and we denote this number by 
Ei, i.e. for i = 1, . . . ,n e 

Ei := nvi{l, 1) = n/ij(l). 

Being permuted the connection among Ei edges of 
edge-type i in a graph, the resulting Tanner graph 
has the same degree distribution pair. The number of 
graphs in the MET-LDPC ensemble is given as follows. 



#C(n,i/(r,x),/i(x)) = [j£? i !. 



(1) 



i=l 
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In this setting, we can see that the graph shown in 
Fig. 1 is an MET-LDPC code in the MET-LDPC code 
ensemble C(n — 40, u(r, x), /x(x)), where 

u(r, x) = 0.5nxl + 0.3nxl + Q.2r x\x\ + 0.2rix 5l 
/z(x) = 0. Ax\x\xz + 0. \x\x2x\ + 0.2x4X5. 



3. Weight Distribution of Multi-Edge type 
Codes 

In this section, we derive the average weight 
distribution of the MET-LDPC code ensemble 
C(n, z/(r, x), /x(x)). For readers who are unfamiliar with 
the enumeration technique of the weight distributions 
in LDPC code ensembles, we refer the readers to [1], 
[12]. 

We consider all the 2 N maps from each variable 
node to {0, 1}, 

x : v >->• x v € {0, 1}. 

We say a map x is a codeword of a code G if ^2 veV x v is 
an even number for every check node c in G, where V c is 
the set of variable nodes adjacent to the check node c in 
G. The weight w{x) of a map x is defined as the number 
of un-punctured variable nodes v such that x v = 1. Let 
Ag(1) be the number of codewords of weight £ in a 
code G. Let A(£) be the average number of codewords 
of weight I for the MET-LDPC code ensemble C(n, i>(r, 
x),/x(x)) defined as follows. 

A(l)= 4(<)/#C(n,Kr,x),Mx)). 

GeC(n,i/(r,x),/i(x)) 

Theorem 1: For a given MET-LDPC code ensemble 
C(n, v(r, x), ^( x ))j the average number of codewords of 
weight I is given as follows. 



coef ((Q(t, s)P(u))™, tVu e ) 



e>0 11 

Q(t,s)= J] (l + i fcl s d ) 



. (2) 



1 \ ei 



b,d>0 



^>=nf (1+u)J ; (1 - u) T - 

d>o V ^ ' 



where 



e — (ei , . . . , e n( ), 

u= (lti,...,ti ne ), 

s = (si,...,s„ c ). 

And coef (<?(x), x d ) is the coefficient of a term x d in a 
multivariate polynomial g(x). 

Proof : An edge is said to be active, if the edge is in- 
cident to a variable node v such that x v — 1. We will 



count all the codewords of weight I in all graphs in 
the ensemble C(n, v(r, x), /x(x)) with active edge of 
edge-type i for i = 1, . . . , n e , and sum them up for all 
e = (ei, . . . ,e„ e ) > 0. Counting all the codewords in- 
volves the following 3 parts: 

1. Count the active edge constellations satisfying all 
the parity-check constraints. 

2. Count the active edge constellations which stem 
from maps of weight I. 

3. Count the edge permutations among active edges 
and non-active edges. 

Before we start counting the active edge constel- 
lations satisfying all the parity-check constraints, first, 
let us count the active edge constellations satisfying a 
single parity-check constraint. Consider a check node c 
of node-type d. In other words, the check node c has 
di edges of edge- type i for i = l,...,n e . The check 
node c is satisfied if the total number of active edges is 
even, i.e. X)"=i e * = even. Let a c (e) be the number of 
active edge constellations which satisfy the check node 
c with given active incident edges of edge-type i for 
i = 1, . . . , n c . It is easily checked that 



o c (e) 



m 





even 



Er=i e i = ° dd 



Let /d(u) the generating function of a c (e) defined as 
/d(u) := ^a c (e)u e . 

e>0 

We can simply describe /d(u) as 



/d(u) 



2 

(l + u) d + (l-u) d 



Next, count the active edge constellations satisfying all 
the parity-check constraints with given e, active 

edges of edge- type i for i = 1, . . . , n t . Since there are 
n/id check nodes of node- type d for d > 0, the number 
of active edge constellations to satisfy all the parity- 
check constraints is given by 



coef(n/d(uH d ,u e ). 



(3) 



d>0 



Secondly, we will count the active edge constel- 
lations which stem from maps of weight I. Count the 
active edge constellations which stem from a single vari- 
able node of weight i = 0, 1 at first. This may be some- 
what confusing since it is too trivial. Consider a vari- 
able node v of channel-type b and node-type d. Assume 
v is given d active edges of edge- type i for i = 1, . . . , n t . 
Let a v (£,h,e) be the number of constellations which 
stem from the maps of weight I G {0, 1}. From the 
definition of the active edges, it is easily checked that 
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1 (^ = 0,e = 0), 
a v (£,b,e)={ 1 (^ = 6i,e = d), 
otherwise. 

Therefore, the generating function of a v (£, b, e) is sim- 
ply written as 

J2 a v (£,b,e)t l s e = l + < bl s d . 

££{0,l},b>0,e>0 

Next, consider all n variable nodes. There are nfb,d 
variable nodes of channel-type b and of node-type d 
for b > and d > 0. It is consequent that for given a 
active edges of edge- type i, the number of active edge 
constellations which stem from maps x : v i-> x v G 
{0, 1} of weight £ is given by 



coef( Y[ (l+i bl s d ) ru/b 'VV). 



(4) 



b.d>0 



In the third place, consider that we are given a 
active edges of edge-type i and hence there are Ei — 
d non-active edges of type i for i = 1, ...,n e . For 
these active edge and non-active edges, the number of 
possible ways of permuting active and non-active edges 
is given as 



J\e t \{E t -e t )\. 



(5) 



Let A e (£) be the average number of graphs which 
have codewords of weight £ for given active edges of 
type i for i = 1, . . . , n e . By multiplying Eq. (3), Eq. (4) 
and Eq. (5), and dividing by the number of codes in 
the ensemble given in Eq. (1), we obtain 



A e (£) =cocf(n/d(u)^ d ,u e ) 



d>0 



c ° ef ( n (i+t bi s d ) m »' d ,t e s e )/~[i 

b,d>0 i=l 



The average number of codewords of weight £ for the 
ensemble is obtained by summing up A e (£) over the all 
possible active edge numbers. 



A(£) = "£A e (£) 



e>0 



(6) 



□ 



4. Asymptotic Analysis 

LDPC codes are usually used with large code length. 
We are interested in the asymptotic average weight dis- 
tributions in the limit of large code length. The average 
number of codewords of weight um is usually increases 
or decays exponentially in n. We focus our interest 
in the asymptotic exponential growth rate of the A{£) 



which is simply referred to as the growth rate 7(0;) de- 
fined as follows. 

7(0;):= lim — logA(wn), 

n— >oo n 

where u> called is the normalized weight of codewords. 

In this section, we derive the growth rate for the 
MET-LDPC code ensemble. To this end, first introduce 
the following lemma. 

Lemma 1 ([12], III. 2): For an to- variable polynomial 
g{x\, . . . , x m ) with non- negative coefficients, it holds 
that 

lim ilogcocf( 3 (x) n ,x a ")- inf log^, 

n— >oo n x>0 x 

where x > means Xi > for all i = 1, . . . , m. The 
point x that takes the minimum of is given by a 
solution of the following equations. 



Xi dff(x) 
g(x) dx t 



a t (i = 1,2, ...,m) 



The number of terms in Eq. (2) is upper-bounded 
by Yli^i Ei- Therefore the largest term alone con- 
tributes the growth rate of A(£). Therefore, from 
Eq. (6) we have 

maxAeW < A{£) < ( JJ^i) max4 e (f) (7) 



-log A(^) = -logmaxA e «) + o(l). (8) 
n n e>o 

Rewriting A e (£) as 

coei((Q(t,s)P(u)) n ,(rs^°^r) 

A ^ Ufl > = n » c / Mi( l )n x . 

lli=l I ftn ) 

(3 = (/?!,..., p nt ), 

where e = n/3 and using Lemma 1, we obtain that 
lim — log A{£) = sup inf 

moo n /3>0 i>0,s>0,u>0 

log Q(s, t) + log P(u) - g Pi lo gK 

i=l 

- A iog(*i) - w log(i) - J2 ^ h { ^T) 



=: sup 7(/3) 

/3>0 



(9) 



A point (u, s, t) that takes inf tjSjU is given as a solution 
of the following equations. 



~Q~ ~ 2-" 1 + t fe is d ' 

^ b,d>0 



(10) 
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dP 



(l+u) d _ (l-u) d 



ft = Ul — = u^ Md ft — — — — — , (11) 



d>0 



dQ 



\ - ^b.dcM bl s d . 

ft = s i^r = > — ■ 1 — ^~ , tor i = 1, . . . , n e . 

bfeo 1 + t6lsd 



(12) 

A point (3 = , /3 n ,) which gives sup^ needs to 

satisfy the stationary condition 



ft 



- ft 

Thus, we obtain the following theorem. 



(13) 



Theorem 2: For a given MET-LDPC code ensemble 
C(n, v(r, x),/i(x)), the growth rate of the normalized 
weight lj is given by 

7(w) := lim — ^4(ojn) = max 7(/3), 

7l->oo n /3e23(w) 

where Q3(w) is a set of (3 such that (10), (11), (12) and 
(13) hold. 

The derivative of 7(/3) in terms of lj can be ex- 
pressed in the following simple expression. 

Lemma 2: For /3 and t such that t ^ and equations 
(10), (11) and (12) hold, we have the following. 

^ 7 (/3) = -log(tM) 

Proof : Let x' denote the derivation of x with respect 
to lj. Differentiating j(oj) defined in (9), we have 



^-7(/3) = ^ + ^--y-E lo S 



Q' , i" f ^, w(i)-ft„, 



Q P t 



ft 



- log t - V (ft log m + ft + ft log s 4 + ft f* ) , 

^— ' Ui -«- 



1=1 



where s is given by equations (10), (11) and (12). From 
(13), we see 

-ft log Uj - ft log Sl - ft' log ^W-^' = 0. 

Pi 

Combining (11) and P' — J2i=i §7T u 'i> we have 



P' 



(14) 



P 

From (10), (12) and Q' = + YZi fH we have 

i=i 

Thus, we can conclude the proof since the remaining 



term in the right hand side of (14) is — logt. □ 

5. Analysis of Small Weight Codeword 

In this section we restrict ourselves to considering un- 
punctured MET-LDPC codes, i.e. 



b= (60,61) = (0,1) for ^b, d /0. 



(15) 



Furthermore, we assume that for every edge-type i 
there exists a check node which has at least 2 edges 
of edge-type i. In precise, for i = 1, . . . , n e , 



3d such that ft > 2 and / 0. 



(16) 



For the standard irregular LDPC codes [20] with a de- 
gree distribution pair (A(x), p(x)), this assumption re- 
duces to the condition of the non-existence of check 
nodes of degree 1, i.e. p'(l) > 0. 

We investigate how the growth rate behaves for 
codewords of small weight, i.e. for small normalized 
weight lj. From the linearity of MET-LDPC codes, 
A(0) = 1 and 7(0) = 0, then from (9) and Lemma 2, it 
follows that for lj — > 0, 



7(cj) = 7'(0)cj + o(lj) 

= sup — log(f)w + o(lj), 



(17) 
(18) 



where 1 is a set of t such that (10), (11), (12) and 
(13) hold for lj — > 0. From the assumption of non- 
puncturing (15) and (10), for lj — > 0, it holds that 
ts d — > for d with fb.d 7^ 0. Using this, it follows 
that ft — >■ for i = 1, . . . ,n e from (12). Using the as- 
sumption of check node-types Eq. (16) and Eq. (11), it 
is consequent that ttj — > for i — 1, . . . , n e . Moreover, 
from (11) it follows that as u — > 0, 

ft = E /"d U ift((ft _ l ) U i + ^2 d 3 U j) + °((E"=l u i) 2 )- 
d>0 j^i 

Substituting this to (13), we have 
Mm (ft 



^TT^ir^+E^iy^+^i^ ( 19 ) 



y 2 



-/i(x). 



dxidxj 

As s — >• 0, from (12) we have 

ft = tsiMi, o) Sl + e ^(1, o)*j) + o((Er=i ^) 2 ) 

Substituting this to (13), we obtain the following. 



"i,i(1.0) 



(20) 
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dxidxj 



i/(r,x) 



We can represent (19) and (20) by matrices as s = Pu 
and u = tA(l)s, respectively, where 



Ai,j(r) := 



P — 



d 2 u( 


r,x) 




dxi 


dxj 


x-G 




9V(x) 






dxidxj 


X-l 





In summary, for i ^ we obtain 

iu = A(l)Pu + (Er=i^)- 



(21) 



This implies that \ is an eigenvalue of A(1)P. Therefore 
sup igT of (17) is achieved by the largest eigenvalue \ 
of A(1)P. Then we have the following theorem. 

Theorem 3: For an MET-LDPC code ensemble 
C(n, ^(r, x), /i(x)), assume the largest eigenvalue \ 
of A(1)P is not zero. The growth rate 7(0;) := 
limn^oo i log A(um) of the average number A(ujn) of 
codewords of weight ton, in the limit of code length, is 
given by 

1 

t 



7(w) = log - \uj + O(o/). 



Furthermore, there exists 5 > such that if j < 1, 
there are exponentially few codewords of weight um for 

LO < S. 

For a standard irregular LDPC code ensemble [16] 
with a given degree distribution pair (X(x),p(x)), can 
be viewed as an MET-LDPC code ensemble 



-)• 

1 ) 



The eigenvalue is given by A'(0)p'(l) which is zero if 
there are no variable nodes of degree 2. The condition 
j < 1 in Theorem 3 reduces to A'(0)p'(l) < 1, which 
coincides with the known result [13]. 

6. Relation with Stability Condition 

In this section, we investigate the connection between 
the growth rate and the stability condition [4]. For 
simplicity, we assume the transmission takes place over 
the binary erasure channels (BEC) with the erasure 
probability e. 

For the standard irregular LDPC code ensemble 
[16] with degree distribution pair (A(x),p(x)), in the 
limit of the code length, we denote the average decoding 
erasure probability of messages sent from variable nodes 
to check nodes at the £-th iteration round by . From 
density evolution [4], p"> is given by 



P i0) =s, 

p& = e\{\- P (l-p^)). 

The following is shown in [4], if eA'(0)//(l) > 1, there 
exists 7 > such that lim^ooj/ > 7. The inequality 



eA'(0)p'(l) < 1 



(22) 



is called the stability condition of density evolution. 
Furthermore, it is shown in [21], the capacity- achieving 
LDPC code ensemble have the degree distribution pair 
(\(x),p(x)) with e\'(0)p'(l) = 1. Meanwhile, it is 
known that the growth rate of the average number of 
codewords of small linear weight um is given by 

lim -logA(um) = log(A'(0)//(l))w + o(w). (23) 

n^oo n 

Interestingly, the same parameter A'(0)p'(l) appears in 
both the stability condition Eq. (22) and the growth 
rate Eq. (23). Does this correspondence also hold for 
the MET-LDPC code ensembles? 

For the MET-LDPC code ensemble with the degree 
distribution pair (j/(r, x), /x(x)), in the limit of large 
code length, let pf^ denote the erasure probability of 
the message sent along the edges of edge-type i from 
variable nodes to check nodes at the £-th intcration 
round. 

From the density evolution developed for the 
MET-LDPC codes [11, Eq. (8)], pf ] is recursively given 
by 



\((l,e),l-p(l-p«-V)) 



A(r,x) : = (Ai(r,x), . . . , A„ c (r,x)), 
p(x) : = (pi(x),...,p n ,(x)), 
^(r,x) 



A,(r,x) 

.(0) 



fi(M)' 

/*(!)' 



where p\"' = e for i = 1, . . . , n e . And it follows that [11, 
Theorem 7] is given as follows. If the spectral radius of 
A(l,e)P is less than 1, there exists 7 > such that 



lim > 7. 



I 

In short, the stability condition for the MET-LDPC 
code is given as follows. 

1 > the spectral radius of A(l,e)P. 

Since A(l,e)P is a non-negative matrix, the spectral 
radius of A(l, e)P is an eigenvalue of A(l, e)P, it follows 
A(l, 1)P coincides with the parameter which appears in 
Theorem 3. 

7. Conclusion 

We present a simple expression of the average weight 
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distributions of MET-LDPC code ensembles which 
gives us a general framework of LDPC codes. We 
showed that the correspondence between the growth 
rate of the weight distributions and the stability condi- 
tion is also the case with the MET-LDPC codes. 
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